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[57] ABSTRACT 

An integrated messaging system uses existing messaging 
equipment to receive, store, retrieve and manage messages 
in media types and formats appropriate to each existing 
system using protocols which are specific to that system. 
Two or more systems are tightly coupled in that a message 
received in one system can be accessed from all systems. 
Coordination between messaging systems is achieved by a 
synchronizer system which periodically connects to each 
system by means of a standard interface and insures that 
messages created or received in one system are distributed 
or identified in all other messaging systems. Thus, the 
messaging systems can operate together even though they 
have different user interfaces, storage designs and formats 
and access and routing protocols. In one embodiment, a 
message received in one system is copied to the other 
system. In another embodiment, the header information in a 
message is preserved in a message created in the other 
system, but the message is not copied. The header informa- 
tion allows the message to be located and reproduced. In still 
another embodiment, one messaging system is designated as 
the single store for all messages, 
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INTEGRATED MULTIMEDIA MESSAGING when a business person is traveling away from the office and 

SYSTEM ^ unreachable via facsimile, incoming faxes can pile up 

back at the office and remain unanswered until that person 

FIELD OF THE INVENTION returns to the office and has the time to examine the faxes 

. i* * i.* a- s and respond. Furthermore, if the business person is staying 

This invention relates to multimedia messaging systems, , , t , . . , A , . ■ , c 

uii^u um UU ikj u iwui & & j , at a hotel where there is no analog telephone hne or jack for 

in general, and. more specifically, to coordination and inter- 4 . , „ * r t , t J , 

& f . . uu *r *■ connecting a modem, e-mail messages cannot be retrieved or 

connection of messaging systems which process information , b A . ' & , 4l _ , 

. , - , . i • ■ i answered. A similar problem occurs when the business 

in different formats, protocols or media types. . . * . . . „. . . 

' K J r person is in a country that has a telephone system sufficiently 

BACKGROUND OF THE INVENTION 10 different from the United States telephone system so that it 

is incompatible with the modem or communications soft- 
Most professionals have several communication channels wafe uged by the person 
by which others can contact them when they ate not physi- ^ d need for ^ ed communication channels 
cally present to receive the contact n,ese channels have ^ ^ b , e i ecomim „ications firms and 
traditionally included voice mail, facsimile ^transmission, nies wnich currenll ofifer t0 , he 
and text-based electronic mad or e-mail. In add-on, paging m m dary ^ which many professionals presently 
systems are commonly used as they provide convenient flnd ^msAves. Many conventional solutions operate- 
messaging to mobile workers. With the advent of v,deo ^ m d of succes ^, D combine two main 
technology video messages are becoming more popular as commun f cat f ons channels, for example, voice-mail and 
a channel of communication as well. Inese communications e 

channels give associates, customers, or other message send- _ " , . . , _ . 

1 ' . ■ -ru One solution presently used tor managing the various 

ers relatively easy access to the message receiver. They . r „ 3 c _ * • ♦ ■ n n a 

„ 4 . j t *u ui- i * * voice mail and e-mail message formats is typically called 

allow teams to work together while enabling closer contact „ „ . fl / , 

^ fe . t . . . "unified messaging . Unified messaging systems differ in 

wi n customers. Communications and messaging are the i i .u * * -i j * -i 

, , . ... ■ ,u * how tightly, or loosely, they join e-mail and voice-mail 

core mechanisms used by most organizations, ensuring that = J> J ! c a _ • u 

r u ■ p *• ^ ~*uu, nn A 25 capabilities. For example, one unified messaging approach 

a wide range of business functions proceed smoothly and ^ . , . • 4 * j- i 7 l , l 

. & r uses a single graphical user interface display to access both 

SWI ^' a voice mailbox and a separate e-mail mailbox. While such 

For example, voice mail has expanded to allow large a m docs aUow the uscr tQ opcrate both the voice mail 

groups of employees, customers, and suppliers to send, m Rnd ^ e _ mail system from a single locatioil) this 

receive, store and manage telephone-based messages. The M 1q , w docs nQt suppQrt acccss wheQ the 

continued populanty of voice messaging as a commumca- ^ . g awa ffom ^ location Mother problem with this 

tions channel is clear. There are more than 50 million voice of systcm ^ ^ ft does nQt prQvide a ^^1^ 

mailboxes worldwide, and the voice-messaging market is method of presenting) crea ting, managing, and filing 

growing at about 25 percent a year. The capabilities of messages> ^ it does litae t0 ^bat the clutter of incoming 

e-mail have also been expanded with the advent of sound- 35 m f orma tj on 

capable computers, which support the use of recorded voice m m technique consolidates both 

clips in e-mail. E-mad u; also phenomenally popular, with voice . mail and c . mail mto onc mailbo an oach m>t 

more than 35 miUion electronic mailboxes m place today-a f g an mvestment m new equip . 

number expected to grow to more than 65 million users by . r> 1 u * u* • Ja-~„ 

"~_ ment. For example, such a system might require adding 

^0 voice messaging capabilities to e-mail server hardware. In 
However, the heterogeneous formats and protocols of addition t0 the high cost of new equipment, this approach 
various message types used in different communication frequently requires network redesign, produces a significant 
channels as well as the different systems required for i ncrea se in administrative burden, and mandates user 
receiving/managing the various messages can also lead to retr aining. Basically, this amount of change results in a loss 
serious challenges for message recipients— challenges that 45 of exisling investments in messaging equipment, 
can lower productivity and make communication a headache Conscquently , there is a need for an effective method of 
rather than a help. storing, retrieving and managing messages which are in 
dearly, there is a need for an effective method of man- different formats and different media types as well as pro- 
aging heterogeneous types of messages and message formats viding a means for access j ng those messages, regardless of 
that may be received by a user. For instance, during a normal 50 tneir form ^ me prot ocol used to manage and store them, 
business day, a person can receive dozens of calls, faxes, from any media that useR3 have ava ii a ble to them, 
voice-mail messages, and e-mail messages. Sometimes, that 

person may receive video and paged messages as well. The SUMMARY OF THE INVENTION 

challenge of managing this steady — sometimes torrential An integrated messaging system uses existing messaging 

— flow of information can be taxing for even the most 55 systems to receive, store, retrieve and manage messages in 

patient person. Information in different forms arrives in media types and formats appropriate to each existing system 

different locations via different machines. Text-based e-mail using protocols which are specific to that system. Two or 

may be received in a user's e-mail mailbox, received voice m0 re systems are tightly coupled in that a message received 

messages may be stored in a separate voice mailbox, video in one system can be accessed from all other systems, 

and paged messages stored in a video and pager mailbox, 60 Coordination between messaging systems is achieved by a 

respectively, while faxed messages may be stored in paper synchronizer system which periodically connects to each 

form in a physical in-box for the recipient to pick up. The system by means of a standard interface and insures that 
recipient must gather this incoming information from all of messages created or received in one system are distributed 

these various locations, review and prioritize it, then respond or identified in all other messaging systems. Thus, the 

in the right format and in a timely manner. 65 messaging systems can operate together even though they 

Hiis can be quite difficult when the recipient is physically have different user interfaces, storage designs and formats 

remote from one or more of the mailboxes. For instance, and access and routing protocols. 
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In one embodiment, a message received in one system is e-mail systems, one or more voice-mail systems, facsimile 

copied to the other system. For example, assuming a voice- management systems, pager systems or the like. The mes- 

mail system is coupled to an e-mail system, if a voice saging system are "heterogeneous" in that each system 

message is received in the voice-mail system, the inventive stores messages in a format and according to a protocol 

integrated messaging system will create an e-mail message 5 which is appropriate to the messages which it receives and 

in the e-mail system with a digitized audio file attachment manages. Even two messaging systems which receive and 

containing the voice message. Conversely, if an e-mail store messages wim the same media types and formats may 

message is received in the e-mail system, the inventive slore messages in different formats and may handle the 

integrated messaging system will create a voice-mail mes- messa S es accordm & t0 different protocols because he sys- 

sage in the voice-mail system with a text component con- 10 tcms were manu actured by different vendors For the pur- 

u^j., „c ,u„ „ poses of illustration, it will be assumed in the following 

taming the text body of the e-mail message. r .... • •, j . 

* , , ., . ... discussion that server 102 is an e-mail server and that server 

In another embodiment, if a message is received in one 1Q4 is a voice . mail server other types of servers could be 

system, identifying information (for example, Originator, used wi|hont departing from the spirjt md scope of lhe 

Date/time received, and Subject) is preserved in a message invention 

created in the othersystem. For example, in an e-mail/voice- " ^ ^ resident 0Q aQ e _ majl &tlyej m wWch 

mail system an e-ma.l message created in the e-mad sys em ^ m ^ fa va|ious medJa for 

for a received voice-mail message in the voice-mail system ^ ^ ^ ffl g aQd stofes , he 

will contain a digiOzed audio file attachment containing ^ iQ stQra assodated ^ , he 

information allowing the invenuve mtegrated messaging ser V er . ^ sy ^ em is a voic^-mail system resident on 

systemtofindthemessageinthevoice-mailsystemandplay M a voice . mail serv£r 104 receives voice . mai i 

it. In this embodiment, other information contained in the m s in ^ audio fo itizes the audio m and 

ongmal message received in one messaging system for ^ ^ ^ ^ ^ a e ^ (he 

example, the voice or text data, is not copied to the other server 

messaging system. ^ e system is shown as network-based and comprises a 

In accordance with yet another embodiment, one messag- number of terminals, such as terminals 106, 108 

ing system is designated as the single store for all messages and uo connected t0 ^crs 102 and 104 by means of a 

regardless of the format in which the messages are received. ]ocal afea network 100 M illustrated in FIG. 1, network 100 

For example, if the aforementioned e-mail system is con- ^ an Ethernet networ k, however, other types of networks 

figured to be the single store for a user's messages, when a ^ caD ^ be used ^ such as token ring? FDDI or other well- 

voice message is received in the voice-mail system, the known networks. The network could be local 

inventive integrated messaging system will create an e-mail (geographically restricted) but could also be a metropolitan 

message in the e-mail system with a digitized audio file area network (MAN) or wide area network (WAN) without 

attachment containing the voice message. The inventive departing from the spirit and principles of the invention, 

system will then delete the original voice message in the ^ E . mailserver 102 can connect with any of computers 106, 

voice-mail system. 108 flnd n0 yift network 100 so that the e-mail system 

BRIEF DESCRIPTION OF THE DRAWING resident thereon can receive and store text-based e-mail 

messages. The digitized text messages can then be presented 

FIG. 1 is a schematic block diagram of an integrated or displayed on display screens in computers 106, 108 and 

messaging system constructed in accordance with the prin- 40 HO. In a similar manner, a voice-mail system resident on 

ciples of the present invention. server 104 can connect with a plurality of telephones, of 

FIG. 2 is a more detailed block schematic diagram of a which telephones 112-116 are shown, by means of commu- 

first messaging system server incorporating a synchronizer nication links 118-122. Communication links 118-122 may 

system for synchronizing the operation of two messaging illustratively be land-based links, radio links or satellite 

systems. 45 links, all of which are available with conventional technol- 

FIG. 3 is a more detailed block schematic diagram of the °gY- The voice-mail system on server 104 can receive analog 

synchronizer of the present invention illustrating the archi- audio signals from telephones 118-122, digitize the signals 

lecture of the logging subsystem. store digitized voice-mail messages on an associated 

. . , , * j. . . . , t , . database (not shown.) Although FIG. 1 illustrates only a 

^ sblock K dia g ramm gating the main data structure l ^ and f voice . mail as men- 

used by the synchronizer illustrated in FIG. 3. tioned ^ cm b& ^ for Qther ^ of 

FIG. 5 is a block schematic diagram illustrating the audio me ssages. For example, a fax/image gateway server may be 

player system in a user computer and the interaction of the uscd to store and forward facsimile messages, a pager server 

audio player system with an optional request agent running can be }Jsed to store and reC eive page messages and a video 

in another server and used to access a voice-mail system. 55 scrvcr may also be ^ to rcccive and slore vidco me ssages. 

FIGS. 6 A and 6B, when placed together, form a flowchart These additional servers, although not shown, can be linked 

illustrating processing of a voice -mail message received in and synchronized in the same manner as will be discussed 

one messaging system. for the e-mail server 102 and the voice-mail server 104. 

FIG. 7 is a flowchart illustrating processing of an e-mail For the purposes of illustration the e-mail messaging 

message received in another messaging system. 60 system running on e-mail server 102 may be a NOTES® 

server which runs a NOTES® integrated database and 

DETAILED DESCRIPTION OF THE c _ mail mcssaging systcm developed and distributed by the 

PREFERRED EMBODIMENTS Deve i 0 pment Corporation located at 55 Cambridge 

FIG. 1 illustrates, in very general form, one embodiment Parkway, Cambridge, Mass. 02142. Similarly, for the pur- 

of the invention utilizing two servers connected to a net- 65 poses of illustration, the voice-mail system running on 

work. Multimedia messaging systems are resident on each voice-mail server 104 may be an INTUITY AUDIX® Mul- 

server. These messaging systems could include one or more timedia Messaging System (MACH 4) system developed 
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and distributed by Lucent Technologies, Inc., located at of the present invention. The synchronizer program 202 

Basking Ridge, N.J. could also run on an independent computer without chang- 

The inventive integrated messaging system enables users ™8 *e operation of the inventive messaging system. The 

to access voice-mail received in the voice-mail system from synchronizer program 202 implements the Unking of e-mail 

the e-mail system and to access e-mail received in the e-mail s messages and voice-mail messages and ts a server process 

system from the voice-mail system. The integrated messag- mat ! s lmU , a . ted ^ admimstrator and is always 

. J . „ * j * t running on the server 200. It comprises several independent 

mg system links a message received in one message store threadi f which rform thc synch F ronizcr operations as dis- 

to the other message store. There are three vanations of cussed jn detai f below 

linked messages. In one embodiment, a message received in Jn ticula ^ the synchronizer application program con- 
one system is copied to the other system. For example, if a 10 ^ a svnchronization/gateway thread 20 3 that communi- 
voice message is received in the voice-mail system, the catcs ^ c . mafl mailboxes 2 10 and the voice-mail server 
inventive integrated messaging system will create an e-mail 2 14 by means of a modified Common Messaging Call 
message in the e-mail system with a digitized audio file (CMC) application programming interface (API). The CMC 
attachment containing the voice message. Conversely, if an API is a standard interface which is described in detail in a 
e-mail message is received in the e-mail system, the inven- ^ X.400 API Association Specification which is hereby incor- 
tive integrated messaging system will create a voice-mail porated by reference. Certain protocol commands have been 
message in the voice-mail system with a text component extended as described below to provide sufficient function- 
containing the text body of the e-mail message. ality to allow operation with a wide variety of messaging 
In another embodiment, if a message is received in one systems. More specifically, the synchronizer program 202 
system, the header or identifying information (Originator, 20 communicates with mailboxes 210 via e-mail CMC inter- 
Date/time received, and Subject) is preserved in a message face 204 and with the voice-mail mailboxes 218 in the 
created in the other system. Also, an e-mail message created voice-mail server 214 by means of the voice-mail CMC 
in the e-mail system for a received voice-mail message in the interface 216 (over a network link 212.) 
voice- mail system will contain a digitized audio file attach- The e-mail CMC interface 204 comprises conversion 
ment containing information allowing the inventive inte- 25 programs which receive the modified CMC protocol com- 
grated messaging system to find the message in the voice- mands from the synchronizer/gateway thread 203 and gen- 
mail system and play it. In this embodiment, other erate commands in the e-mail system native interface and 
information contained in the original message received in the voice-mail CMC interface 216 converts the CMC pro- 
one mail system, for example, the voice or text data, is not tocol commands to commands in the native interface of the 
copied to the other mail system. voice -mail messaging system. Both the e-mail CMC inter- 
In accordance with yet another embodiment, one mail face 204 and the voice -mail CMC interface 216 implement 
system is designated as the single store for all voice mes- a subset of the CMC commands, which subset includes the 
sages and e-mail messages. For example, if the e-mail following commands: 
system is configured to be the single store for a user's 35 

messages, when a voice message is received in the voice- — — — — ; ~™ 

. . t . j • , * n Act On Performs an action on a specified message. The actions include 

mail system, the inventive integrated messaging system will del6tion of a m ^ &t) J.^ q[ & mcsfi f ge and mar]dng ^ 

create an e-mail message in the e-mail system with a message as read. 

digitized audio file attachment containing the Voice mes- List Generates lists with summary information about messages which 

sage. The inventive system will then delete the original meet specified criteria. 

• -i . 4U Read Reads a message from a specified user's mailbox. 

voice message in the voice-mail system. Ree Fxa mcmmy ^ located ^ ^ 

The integrated messaging system includes an audio player Logon Logs on the interface 

application program which runs in a user's computer and Logoff Logs off the interface 

allows the user to play digitized audio file attachments in — — 

e-mail documents on the user's multimedia PC or on the 45 j^c CMC API allows for extensions to each of the corn- 
telephone. The audio player, optionally in conjunction with ma nds and to the data associated with each of the com- 
a request agent program, can also access the voice-mail man ds. These extensions are used to perform functions not 
system to retrieve and play files stored thereon in the case included in the published CMC API specifications. Most 
where copies of the files are not available on the e-mail extensions are optional and may or may not be supported by 
system. The audio player application displays controls, such 50 par a cu i ar messaging systems. The set of extensions actually 
as pause, rewind, and seek on the PC monitor which can all used ^ a paruC ular messaging system are determined 
be used to control playback. The same controls can also be wnen lne synchronizer logs onto the messaging system. At 
used when messages are played over the telephone. mat limt ^ a query ^ sent by the synchronizer to the mes- 
The request agent program runs either on the e-mail saging system to determine the capabilities of the messaging 
server or on a standalone machine and allows the audio 55 system and the extensions used are based on those capabili- 
player program to access the voice-mail server in order to ties. In the illustrative embodiments, the extensions have 
play voice messages on the telephone or to retrieve voice been used to interface the CMC commands with the e-mail 
messages from the voice-mail system to play on a user's internal interface calls and with the voice-mail internal 
multimedia computer in the case where the user's computer interface calls. 

cannot access the voice-mail system with the correct proto- 60 The following extensions are used for the main com- 

col. In one illustrative embodiment, the request agent pro- mands: 

gram uses an IPX/SPX protocol to communicate with the Act On 

audio player on the user's desktop and uses a TCP/IP Delivery Failure Reason 

protocol to communicate with the voice-mail server. Unique Message ID 

FIG. 2 is a high-level block diagram illustrating the 65 Save Message 

configuration of an e-mail server 200 which incorporates a Intended Recipient 

synchronizer program 202 in accordance with the principles Mail Route Servers 
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The functions of the e-mail CMC interface 204 and the 
voice- mail CMC interface 216 are accessible through ses- 



10 



voice-mail mailbox. Once a user session is active, the 
synchronizer 202 may get message summary information on 
a particular mailbox database, or a filtered subset of it 
through a CMC List request. It may then use the CMC Read 
function to read particular messages from that mailbox. 
When the synchronizer 202 determines that a message must 
be saved, marked as read, or deleted, it makes a CMC Act 
On request during an active session. When all needed 
message processing has been completed for a particular 
e-mail and voice -mail user, the synchronizer 202 terminates 
the session by making a CMC Logoff request for that user. 
When message processing for all configured e-mail and 
voice-mail users has been completed, the synchronizer 202 
terminates the server session by making a CMC Logoff 
request. 

15 FIG. 3 illustrates, in more detail, the structure of the 
synchronizer program 202. The synchronizer program 202 
links a user's voice-mail messages in the voice-mail system 
with e-mail messages in the e-mail system. The synchronizer 
program 300 comprises a scheduler 302 which maintains a 
20 state database 306 (via an update thread, not shown) so that 
when a message changes state (deleted or marked read) in 
one message system, the linked message in the other mes- 
sage system can be found and a similar state change applied. 
The state database 306 is the repository of all state 
25 information about the messages that are synchronized 
between a user's two mailboxes. The state database 306 is 
persistent and is saved on disk. The scheduler 302 creates a 
state database update thread (not shown) and schedules the 
update thread when the synch/gateway thread 304 indicates 
30 a user's message state has changed. 

Synchronizer program 300 also provides, via a sync/ 
gateway thread 304, gateway functionality between the 
voice-mail system and the e-mail system, thereby allowing 
messages to be transferred from the voice-mail system to the 
35 e-mail system and from the e-mail system to the voice-mail 
system as previously described. For example, if an e-mail 
message is synchronized to a voice -mail message, the user 
can listen to the e-mail message using the voice -mail system 
and record a voice reply. The reply message will be sent via 
40 the synch/gateway thread 304 directly to the originator's 
e-mail mailbox. 

The synchronizer program 300 is composed of several 
components, including a scheduler 302 which initializes and 
starts up the other components. The scheduler 302 reads 



sions. A session is created when a CMC Logon request is 45 configuration data and sets up internal data structures con- 



made, and terminated when a CMC Logoff request is made. 
The synchronizer 202 establishes sessions at regular 
intervals, or passes, as instructed by the configuration 
database, to enable it to access the interface functionality. 
Two different types of sessions are created, one containing so 
the other. The first type, called a "trusted" server session, is 
created by the synchronizer 202 and provides password 
authorization for all succeeding sessions contained within it. 
Effectively, the trusted server session allows the synchro- 
nizer to access user mailboxes in an appropriate messaging 55 
system without a password. This simplifies administration 
and allows users to change their passwords without inform- 
ing the synchronizer. During a trusted server session, the 
synchronizer logs on to both the e-mail and the voice-mail 
systems. This session is also used to obtain configuration 60 
information right after the synchronizer 202 is started. The 
second type, a user session, is also created by the synchro- 
nizer 202, and is associated with a trusted server session. It 
provides access to a particular user's e-mail and voice-mail 



taining the configuration. Before each synchronization cycle 
is started the scheduler 302 checks whether any configura- 
tion data has changed and includes any changes in the active 
configuration. 

Scheduler 302 also assigns user mailbox pairs that need to 
be synchronized to synch/gateway thread 304, which will 
perform the synchronization. Likewise, the scheduler 302 
assigns configured gateways to the sync/gateway thread 304, 
which will route messages between the voice-mail and 
e-mail systems. Finally, scheduler 302 gracefully shuts 
down other software components and stores existing data 
structures when it is aborted by the administrator. 

The synch/gateway thread 304 manages the link between 
a user's voice-mail mailbox and e-mail mailbox. It uses the 
state database 306 to save the state of each user's message 
in each system and updates the message in one system when 
its state changes in the other system. In addition, the 
sync/gateway thread 304 delivers e-mail messages 
addressed to voice-mail users and voice-mail messages 



mailboxes. During an e-mail server session, the synchro- 65 addressed to e-mail users, 
nizer 202 creates user sessions, one at a time, to access A logging subsystem 308 enables the synchronizer 300 to 
messages in each user's respective e-mail mailbox and log events and errors to a system console (not shown), an 
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e-mail log database 314, via an e-mail log queue 310 or a 
voice-mail log database 324 via a voice-mail log queue 315. 
The synchronizer 300 decides what to log and the logging 
subsystem 308 formats and delivers the message to the 
requested output device. Logging subsystem 308 creates a 
queue (310 and 315) and a separate thread (311 and 317) for 
each messaging system. The thread empties its assigned 
queue and passes the logged message to the messaging 
system. Since the logging system in the illustrative embodi- 
ment is operating in the e-mail server, the e-mail log queue 
310 and the e-mail log database 314 are located in the e-mail 
server and can be accessed directly. 

The voice-mail log thread 317 communicates with the 
voice-mail server 318 by means of a CMC interface 312. 
The CMC interface 312 converts logging commands into the 
voice-mail system native interface. The native interface 
commands are sent over a network, schematically illustrated 
as network 316, to the voice -mail server 318. The voice-mail 
log database 324 is located in the voice-mail server 318. 

There are a number of global data structures that are 
shared by the various subsystems of the synchronizer pro- 
gram 300. The scheduler 302 creates these data structures 
during startup of the synchronizer program 300 and the data 
structures are illustrated in more detail in FIG. 4 where a 
main data structure comprises a pointer table 400 which 
contains a number of pointers, 402-412, to various other 
structures 414-424. These pointers include a pointer 
pSchedG 401 to a structure 413 containing information used 
by the scheduler. Another pointer pEmailG 402 points to a 
structure 414 containing information about the e-mail sys- 
tem. In particular, structure 414 contains function pointers to 
the e-mail CMC function call entry points. 

A pointer pVmailG 404 is also included to a structure 416 
containing information about the voice-mail system. In 
particular, structure 416 contains the function pointers to the 
voice-mail CMC function call entry points. 

Another included pointer is pointer pSyncG 406 to a 
structure 418 containing information needed by the sched- 
uler 302, such as the current synchronization state. A pointer 
pSvrG 408 identifies a linked list 420 of structures contain- 
ing information about configured mail system servers that 
synchronizer 300 accesses. In the illustrative embodiment, 
there are at least two mail system nodes in the list — an 
e-mail server information node and a voice-mail server 
information node. In systems which include other servers, an 
information structure for each other server would be linked 
to the list. Configuration information such as server name, as 
well as run-time information, such as current session ID, are 
contained in the linked data structures 420 for each server. 

Another pointer pGwG 410 identifies a linked list 422 of 
structures containing information about gateways config- 
ured for synchronizer 300. A further pointer pUserG 412 
points to a linked list 424 of structures containing informa- 
tion about users configured for synchronizer 300. 

Synchronizer 300 is designed to create multiple synch/ 
gateway threads of which thread 304 is illustrated. Sched- 
uler 302 controls the processing of messages in user and 
gateway mailboxes by scheduling the synch/gateway thread 
304, At each synchronization cycle, scheduler 302 sends a 
command to synch/gateway thread 304 to process cross- 
domain messages for a gateway configured for synchronizer 
300 and identified in linked list 422. To process this 
command, thread 304 assumes a gateway thread context for 
a configured gateway and delivers cross-domain messages 
that have been previously queued for delivery either into a 
e-mail foreign domain mailbox or into a cross-domain queue 
for this gateway. After processing of the gateway is 
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complete, scheduler 302 will assign another configured 
gateway from list 422 to be processed by the sync/gateway 
thread 304 until all configured gateways have been pro- 
cessed. 

5 After all gateways have been processed, scheduler 302 
sends a command to the synch/gateway thread 304 to 
process messages for a user configured for synchronizer 300 
and selected from list 424. Thread 304 now assumes a 
synchronizer thread context for this user and synchronizes 

to any messages that need synchronization, i.e., either new 
messages or old messages that have changed state. When a 
user's mailboxes have been synchronized, the synch/ 
gateway thread 304 signals scheduler 302 that it is done and 
scheduler 302 assigns another user to the synch/gateway 

15 thread 304 until all users configured for synchronizer 300 
and appearing on list 424 have been processed. The sched- 
uler 302 supports several notification methods from each 
messaging system. When the synchronizer 300 starts, the 
scheduler 302 queries each messaging system to find which 

20 event notification type is compatible with that system. 
The notification types are 

No Event: No event notification is supported by the 
messaging system. In this case, scheduler 302 schedules a 
session for each user during each trusted server session. 

25 Poll Event: The messaging system serves specific events 
which the synchronizer 300 must poll the messaging system 
to get, for example, message deleted, message added. 

Poll Event Mailbox: The messaging system queues events 
which the synchronizer 300 must poll to get but the events 

30 only tell which user mailbox changed, not what the specific 
changes were. 

Callback Event: Similar to the Poll Event but the CMC 
interface uses a callback entry point into the synchronizer to 
report events instead of requiring the synchronizer to poll 

35 the messaging system. 

Callback Event Mailbox: Similar to the Poll Event Mail- 
box but the CMC interface uses a callback entry point into 
the synchronizer to report events instead of requiring the 
synchronizer to poll the messaging system. 

40 If there have been changes since the last sync cycle, 
synch/gateway thread 304 will set a flag in the user con- 
figuration structure on list 424 to indicate that the persistent 
version of the state database 306 must be updated. When 
scheduler 302 is signaled by synch/gateway thread 304 that 

45 it is finished processing a user, scheduler 302 will check this 
flag in the user configuration structure on list 424. If the 
aforementioned flag is set, scheduler 302 will send a mes- 
sage to a state database update thread to update the persistent 
version of the user's file in state database 306. 

50 The synchronizer 300 also includes e-mail and voice-mail 
log threads (311 and 317, respectively) which are controlled 
by scheduler 302 somewhat differently. The logging sub- 
system 308 for a mail system is initialized during process 
startup and terminated during process shut down by sched- 

55 uler 302. Logging subsystem 308 is also paused before a 
mail system server logs off and continued after a mail system 
server logs on. Server sessions may be created and termi- 
nated for each synchronization cycle or server sessions may 
be preserved unless scheduler 302 detects a configuration 

60 change, as previously discussed. Then, the session is termi- 
nated and a new server logon is initiated with the new 
configuration settings. When a log thread has been initial- 
ized and is not paused, it processes log messages kept in a 
log queue created for a particular mail system, such as log 

65 queues 310 and 315. 

Synchronizer 300 is in one of six fundamental states 
including: Startup where the synchronizer program has just 



12/26/2003, EAST Version: 1.4.1 



5,951,638 

11 12 

been started and initialization of the process context, includ- Request agent 516 is server application which provides 

ing reading the administered configuration, is taking place. audio player clients the ability to access voice mail services 

Synchronizer 300 interfaces with the mail systems through without being tied to a specific network transport. Request 

the CMC interfaces 204 and 216 (FIG. 2) supplied for each. agent 516 runs in a standalone server 524 and accepts 

During the startup state, scheduler 302 loads the CMC 5 network messages from audio player 504 from a CMC 

libraries for both mail systems. Scheduler 302 then initial- interface. In particular, audio player 504 uses a CMC remote 

izes the CMC function pointer table in each mail system procedure call (RPC) stub 508 to generate CMC requests in 

structure (414 and 416) with the addresses of the entry points a network protocol. These requests are transferred over a 

for each CMC API function. Each CMC API function has network 510 to a CMC RPC stub 514 located in the server 

been written using the appropriate calls in the e-mail API or io 524 where the request agent 516 is running. Request agent 

the voice-mail API function set. 516 then "reconstructs" those messages and passes them on 

The next synchronizer state is Idle where the synchronizer to the voice-mail server 512 via a voice-mail CMC interface 

is between synchronization intervals. Further states include 518 and another network schematically shown as network 

Initial Sync where synchronizer 300 is performing its first 520. Any resulting data or status information is then passed 

synchronization cycle after startup and Sync where synch/ 15 back to the audio player 504 via the network 520, the 

gateway thread 304 and/or database update threads are voice -mail CMC interface 518, the CMC RPC stub 514, the 

executing. During this latter state, scheduler 302 sends network 510 and the RPC stub 508. Using this arrangement, 

commands and waits for replies from the synchronizer request agent 516 can accept requests from audio player 504 

thread and the database update thread (not shown). This via any convenient transport protocol, 

communication is managed by a pair of semaphores for 20 Request agent 516 has the following states: Initializing, 

scheduler-synchronizer thread communication and another Listening (waiting for Audio Player client requests), Client 

pair of semaphores for scheduler-database update thread Session Management (when an Audio Player establishes a 

communication. A data structure is used for managing session) and Shutting down. The Request Agent uses both 

communication between threads and a separate data struc- multiple threads and multiple processes. The R PCS tart 

ture is allocated for each thread that the scheduler 302 25 thread routine runs as a separate thread which initializes all 

controls. Each data structure contains the handles for the network transports that are to be configured and then 

semaphores used and structure members for the commands launches a listener thread for each. The RPCStart thread then 

and return codes passed between the scheduler and the waits for a request agent shutdown message and finally 

threads. It also contains a data member used by the scheduler cleans up any resources utilized. 

and the associated thread to signal that the scheduler has 30 An RPCStartClientConnection routine runs as a separate 

information for the thread or that the thread has information thread. It gets called by a transport's network listener thread 

for the scheduler. For example, the scheduler 302 can first when an audio player client wishes to start a session. When 

set the data in the data structure to command a synchroni- the request agent 516 is running in multi-threaded mode, the 

zation and to indicate to the synchronizer thread which user RPCStartClientConnection thread manages an audio player 

needs to be synchronized and then can set the thread 35 session by taking any requests and translating them into the 

semaphore to signal the synchronizer thread to process the voice -mail CMC interface 518 functions, 

command. When the synchronizer thread is finished it sets When the request agent 516 is running in single-threaded 

the data to indicate the result of its processing other user's mode, the RPCStartClientConnection thread creates a child 

mailboxes and then sets the scheduler semaphore to single request agent (CRA) for the session and then informs the 

the scheduler 302 to process the results. co audio player which started the session of the CRA's network 

An intermediate state is Initial Shutdown which is entered connection so the audio player can reconnect to it. The 

if shutdown in requested before initialization is complete. In RPCStartClientConnection thread then waits for the CRA to 

this state synchronizer 300 gracefully shuts down. end and then performs any necessary cleanup. 

The final synchronizer state is Shutdown where synchro- The RPCProcessOientRequest routine takes an encoded 

nizer 300 is in the process of gracefully terminating the 45 network message from an audio player client, performs the 

process. necessary translations and then re-encodes a response which 

Two other system components can also be used with the is then shipped back to the audio player, 

inventive messaging system. These include an audio player FIGS. 6A and 6B form a flowchart which illustrates 

program and a request agent. Both of these components are processing by the inventive integrated messaging system 

illustrated in FIG. 5. The audio player 504 is an end user 50 when a voice message is received by the voice-mail system, 

application which is invoked by the end user on a worksta- As shown in FIG. 6A, the routine begins in step 600 and 

tion 500 to handle a voice -mail attachment to an e-mail proceeds to step 602 where the incoming voice message is 

document. Audio player 504 comprises a conventional audio stored in the voice-mail system generally in the form of a 

playback program which can be controlled by a graphical digitized audio file. 

user interface 502 to reproduce a digitized audio file on a 55 In step 604 the change in the user's voice -mail mailbox is 
sound card 506 mounted in the user's workstation 500. noted during processing of the user's e-mail and voice-mail 
When the digitized audio file is attached to an e-mail mailboxes by a synch/gateway thread operating in the syn- 
document, the e-mail system, which is also running on the chronization mode as previously described. At this point 
user's workstation 500, can be used to retrieve the e-mail processing of the received voice-mail message is corn- 
document and provide the digitized audio file attachment to 60 menced. The routine proceeds to step 606 in which a 
audio player 504. decision is made whether the system is operating in a full 
In other cases, the digitized audio file is not stored in the copy mode or in a headers only mode. If a decision is made 
e-mail system, but is instead resident in the voice-mail in step 606 that the messaging system is operating in full 
system. In this latter case, the audio player 504 can access copy mode, the digitized voice -mail message is read from 
the voice-mail server 512 to retrieve the digitized audio file 65 the voice-mail system by the synchronization thread in step 
into the user's workstation 500 where the audio player 504 608 using the appropriate CMC commands. In step 610, the 
can reproduce it. synchronization thread creates an e-mail message (not 
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shown) in the user's mailbox containing the voice message 
as a digitized audio attachment. 

The routine then proceeds, via off-page connectors 614 
and 624 to step 625 (FIG. 6B) where the user logs onto the 
e-mail system and opens the message. In step 626, the user 5 
can then open the e-mail document with the digitized audio 
attachment by launching an audio player program in the 
user's computer to listen to the digitized audio message. The 
routine then finishes in step 638. 

Alternatively, if in step 606, a decision is made that the 10 
system is operating in a headers only mode, in which only 
message headers, or other identification information, are 
stored on the e-mail system, the routine proceeds to step 616 
in which the identification information is read from the 
voice-mail system, again using the CMC interface calls, as ^ 
previously described. 

In step 618, a message is created in the e-mail system with 
the information retrieved from the voice -mail system as an 
attachment. 

The routine then proceeds, via off-page connectors 622 2 o 
and 628, to step 630 where the user launches the audio 
player in his workstation in order to listen to the message. 
The audio player program in the user's computer either 
connects directly to a voice-mail server or connects to a 
request agent (step 632) and the request agent connects to 2 s 
the voice-mail system in order to retrieve the digitized voice 
file (step 634) so that the file can be played in the audio 
player as illustrated in step 636. The routine then finishes in 
step 638. Alternatively, after receiving the e-mail message, 
the user can listen to the voice -mail message via a telephone 30 
in the normal voice-mail system fashion (not shown.) 

FIG. 7 illustrates processing commenced by the inventive 
system after an e-mail message is received by the e-mail 
system. The illustrative routine starts in step 700 and pro- 
ceeds to step 702 in which the received text e-mail message 35 
is stored in the e-mail system. This change is noted during 
a synchronization session for the user as noted in step 704. 
The synch/gateway thread then creates an voice-mail mes- 
sage in the user's voice -mail mailbox containing the e-mail 
text message as a text component as shown in steps 706 and 40 
708. In voice -mail systems, binary attachments can often be 
added as a binary component to the voice message. 
Similarly, fax attachments can be added as a fax component 
to the voice message and digitized voice files can be added 
as a voice component to the voice message. The user may 45 
log on to the voice -mail system as indicated in step 710 and 
listen to the text or voice component of the e-mail via a 
telephone. The voice-mail system provides text-to-speech 
conversion for the text component as shown in step 712. The 
routine then finishes as illustrated in step 714. 50 

While the invention has been shown and described above 
with respect to various preferred embodiments, it will be 
apparent that the foregoing and other changes of the form 
and detail may be made therein by one skilled in the art 
without departing from the spirit and scope of the invention. 55 
These and other obvious modifications are intended to be 
covered by the following claims. 

What is claimed is; 

1. Apparatus for use on a digital network for coordinating 
messages received in both a first messaging system which 60 
receives and stores messages in a first format and a second 
heterogeneous messaging system which receives and stores 
messages in a second format, the apparatus comprising: 
a synchronizer connected to the network; 
a first standard interface connecting the synchronizer to 65 
the first messaging system to allow the synchronizer to 
control the first messaging system; 



a second standard interface connecting the synchronizer 
to the second messaging system to allow the synchro- 
nizer to control the second messaging system; 

a first mechanism in the synchronizer for examining the 
second messaging system and for insuring that infor- 
mation is stored in the first messaging system corre- 
sponding to messages stored in second messaging 
system; and 

a second mechanism in the synchronizer cooperating with 
the first mechanism for deleting messages stored in the 
second messaging system corresponding to the infor- 
mation stored in the first messaging system. 

2. Apparatus according to claim 1 wherein the digital 
network has a user computer connected thereto and the 
apparatus further comprises means for presenting on the user 
computer messages stored in the first messaging system in 
the first format. 

3. Apparatus according to claim 2 wherein the apparatus 
further comprises means for presenting on the user computer 
messages stored in the first messaging system in the second 
format, 

4. Apparatus according to claim 1 wherein the first 
mechanism stores information identifying messages stored 
in the second messaging system. 

5. Apparatus according to claim 1 wherein the first 
mechanism comprises a synchronization mechanism which 
is responsive to messages received at the second messaging 
system for generating messages in the first format containing 
equivalent information and storing the generated first format 
messages in the first messaging system. 

6. Apparatus according to claim 1 wherein the first 
mechanism comprises a synchronization mechanism which 
is responsive to messages received at the second messaging 
system for generating messages in the second format con- 
taining equivalent information and storing the generated 
second format messages in the first messaging system. 

7. An integrated multimedia messaging system for use on 
a digital network, the system comprising: 

a first message server comprising a storage and connected 
to the network for receiving messages in a first format 
and for digitizing first format messages and storing the 
digitized first format messages in the storage along with 
state information indicating whether the first format 
messages have been read and identification information 
uniquely identifying each first format message; 

a second message server comprising a storage connected 
to the network for receiving messages in a second 
format different from the first format and for digitizing 
second format messages and storing the digitized sec- 
ond format messages in the storage along with state 
information indicating whether the second format mes- 
sages have been read and identification information 
uniquely identifying each second format message; 

a synchronizer connected to the network for insuring that 
message information is stored in the first server storage 
for both first format messages stored in the first server 
storage and second format messages stored in the 
second server storage; and 

a mechanism in the synchronizer which is responsive to 
second format message information being stored in the 
first server storage for accessing the second server 
using the message information stored in the first server 
to delete second format messages stored therein. 

8. A system according to claim 7 further comprising a first 
workstation connected to the network including a message 
program for accessing the first server and retrieving mes- 
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sages stored therein and including a presentation mechanism 
for presenting both first format messages and second format 
messages to a user. 

9. A system according to claim 7 further comprising a first 
workstation connected to the network including a message 
program for accessing the first server and retrieving mes- 
sages stored therein, and further comprising a presenting 
mechanism for presenting first format messages and a con- 
version mechanism for converting second format messages 
to first format messages so that the first station can present 
second format messages. 

10. A system according to claim 7 wherein the first server 
comprises a gateway mechanism which is responsive to 
second format messages received at the second server for 
generating first format messages containing equivalent 
information and storing the generated first format messages 
in the first server storage. 

11. A method for use on a digital network for coordinating 
messages received in both a first messaging system which 
receives and stores messages in a first format and a second 
heterogeneous messaging system which receives and stores 
messages in a second format, the method comprising the 
steps of: 

A. creating a synchronizer and connecting it to the net- 
work; 

B. connecting the synchronizer to the first messaging 
system by means of a first standard interface to allow 
the synchronizer to control the first messaging system; 

C. connecting the synchronizer to the second messaging 
system by means of a second standard interface to 
allow the synchronizer to control the second messaging 
system; 

D. using a first mechanism in the synchronizer to examine 
the second messaging system and to insure that infor- 
mation is stored in the first messaging system corre- 
sponding to messages stored in second messaging 
system; and 

E. using a second mechanism in the synchronizer to 
examine the first messaging system and to delete mes- 
sages stored in the second messaging system corre- 
sponding to the information stored in first messaging 
system. 

12. A method according to claim 11 wherein step D 
comprises the step of: 

Dl. storing information identifying messages stored in the 
second messaging system. 

13. A method according to claim 11 wherein step D 
comprises the step of: 

D2. in response to messages received at the second 
messaging system, generating messages in the first 
format containing equivalent information and storing 
the generated first format messages in the first messag- 
ing system. 

14. A method according to claim 11 wherein the digital 
network has a user computer connected thereto and the 
method further comprises the steps of: 

R presenting on the user computer messages stored in the 
first messaging system in the first format; and 
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G. presenting on the user computer messages stored in the 
first messaging system in the second format. 

15. A computer program product for use on a digital 
network for coordinating messages received in both a first 
messaging system which receives and stores messages in a 
first format and a second heterogeneous messaging system 
which receives and stores messages in a second format, the 
computer program product comprising a computer usable 
medium having computer readable program code thereon, 
the program code including: 

program code for creating synchronizer connected to the 
network; 

program code for creating a first standard interface con- 
necting the synchronizer to the first messaging system 
to allow the synchronizer to control the first messaging 
system; 

program code for creating a second standard interface 
connecting the synchronizer to the second messaging 
system to allow the synchronizer to control the second 
messaging system; 

first program code in the synchronizer for examining the 
second messaging system and for insuring that infor- 
mation is stored in the first messaging system corre- 
sponding to messages stored in second messaging 
system; and 

second program code in the synchronizer for examining 
the first messaging system and for deleting messages in 
the second messaging system corresponding to mes- 
sages stored in first messaging system. 

16. A computer program product according to claim 15 
wherein the digital network has a user computer connected 
thereto and the computer program product further comprises 
program code for presenting on the user computer messages 
stored in the first messaging system in the first format. 

17. A computer program product according to claim 16 
wherein the computer program product further comprises 
program code for presenting on the user computer messages 
stored in the first messaging system in the second format. 

18. A computer program product according to claim 15 
wherein the first program code in the synchronizer stores 
information identifying messages stored in the second mes- 
saging system. 

19. A computer program product according to claim 15 
wherein the first program code in the synchronizer com- 
prises program code which is responsive to messages 
received at the second messaging system for generating 
messages in the first format containing equivalent informa- 
tion and storing the generated first format messages in the 
first messaging system. 

20. A computer program product according to claim 15 
wherein the second program code in the synchronizer com- 
prises program code which is responsive to messages 
received at the second messaging system for generating 
messages in the second format containing equivalent infor- 
mation and storing the generated second format messages in 
the first messaging system. 
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